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Abstract. In this paper we present and evaluate a search strategy called 
Decomposition Based Search (DBS) which is based on two steps: sub- 
problem generation and subproblem solution. The generation of subprob- 
lems is done through value ranking and domain splitting. Subdomains are 
explored so as to generate, according to the heuristic chosen, promising 
subproblems first. 

We show that two well known search strategies. Limited Discrepancy 
Search (LDS) and Iterative Broadening (IB), can be seen as special cases 
of DBS. First we present a tuning of DBS that visits the same search 
nodes as IB, but avoids restarts. Then we compare both theoretically 
and computationally DBS and LDS using the same heuristic. We prove 
that DBS has a higher probability of being successful than LDS on a 
comparable number of nodes, under realistic assumptions. Experiments 
on a constraint satisfaction problem and an optimization problem show 
that DBS is indeed very effective if compared to LDS. 



1 Introduction 

In this work we present a search strategy, called Decomposition Based Search 
(DBS) for the solution of constraint satisfaction and optimization problems. The 
search strategy is organized in two steps: subproblem generation and subproblem 
solution. In the first phase, domain values are ranked and ordered accordingly for 
decreasing ranks. Based on this ranking, domains are partitioned in two or more 
subdomains. Subproblems then consist of the initial problem, in which variables 
range over one of their subdomains. In the second phase of DBS the subproblems 
are being solved. The first subproblem is considered the most promising one, 
according to the ranking, to contain a (good) solution. 

The actual generation of subproblems is managed by a tree search in which we 
branch on subdomains. Although this tree can be traversed using any strategy, 
we prefer to use an LDS-based strategy because it generates the most promising 
subproblem first. If the ranking is accurate, we are likely to find feasible solutions 
or good solutions (for optimization problems) early during the search process, 



which in the second case is an extremely helpful condition to prove optimal- 
ity relatively fast (see also [9]). On the other hand, the search process can be 
stopped once the current best solution satisfies the user's needs, thus obtaining 
an incomplete search strategy. 

DBS has several degrees of freedom, whose tuning leads to different explo- 
rations of the subproblem generation tree. Beside the (traditional) variable and 
value ordering heuristics, in DBS we have to tune other parameters concerning 
the partitioning of domains. Specifically, the size and the number of subdomains 
should be tuned and domains can be partitioned statically or dynamically. Stat- 
ically means that domains are divided once for all at the root node while dy- 
namically means that at each level of the search tree we select a variable and we 
partition its domain (which can be already partly pruned by propagation). 

This simple idea was first presented in [1] for scheduling problems modelled 
through position variables. This paper can be seen as a generalization and an 
extension of our previous work [10]. In that paper, we were mainly concerned to 
show the efi^ectiveness of a reduced cost based ranking. In this paper, instead, we 
will theoretically and computationally evaluate this search strategy and compare 
it with other search strategies. To show its behaviour in practice, we apply DBS 
to both constraint satisfaction and optimization problems. 

Concerning the comparison with other search strategies, we first present a 
tuning of DBS such that it traverses the same nodes of the search tree as Iterative 
Broadening (IB). Moreover, since DBS avoids the restarts of IB, it generates less 
leaf nodes. Next we consider traditional Limited Discrepancy Search (LDS) and 
show the equivalence with DBS when the cardinality of each subdomain is equal 
to one. In addition, we show that by considering more than one value in each 
subdomain, under realistic conditions, DBS has a higher probability of being 
successful than LDS on a comparable number of generated nodes. Then, we 
show experimental behaviour of LDS and DBS on the whole search tree, given a 
number of probability distributions among the branches being successful. Finally, 
we consider a constraint satisfaction problem, namely the partial latin square 
completion problem and a combinatorial optimization problem, the traveling 
salesman problem. We apply LDS and DBS to these problems using the same 
variable and value ordering heuristics and show that DBS outperforms LDS in 
almost all cases. 

The paper is organized as follows. The next section introduces some prelimi- 
naries. In Section 3 we propose the subproblem generation scheme. In Section 4, 
we perform a theoretical comparison with IB and LDS. In Section 5, we present 
a computational study of DBS experimenting it both on constraint satisfaction 
and optimization problems. We conclude in Section 6. 

2 Definitions 

In this work we consider Constraint Satisfaction Problems (or CSPs), possibly 
together with an objective function to be optimized. A Constraint Satisfaction 
Problem P is defined by the triple {X,V,C), where X = {xi, . . . ,a;„} is a set of 



variables, V = {Di, . . . , D„} is a set of variable domains, and C = {Ci, . . . , Cm} 
is a set of constraints Cj{xi^ ,Xi^) {j = 1, . . . , m) over variables {k < n). A 
solution s to P is an assignment of each variable to a value in its domain such 
that all constraints are satisfied. 

As far as search trees are concerned, we follow the concepts and vocabulary- 
introduced by Perron [11] and Van Hentenryck et al. [6]. A search tree consists of 
three disjoint sets of nodes that are connected to each other: open nodes, closed 
nodes and unexplored nodes. The connection between the three is as follows: 

— all ancestors of an open node in a search tree are closed nodes, 

— each unexplored node has exactly one open node as its ancestor, 

— no closed node has an open node as its ancestor. 

The set of open nodes is called the search frontier. The search frontier evolves 
by so called node expansion. This operation removes an open node from the 
frontier, transforms it to a closed node, and adds the unexplored children of the 
node to the frontier. It corresponds to the branch operation in the Branch & 
Bound algorithm. In this work, nodes represent CSPs. 

3 Decomposition Based Search 

Decomposition Based Search is a two-phase search strategy, consisting of sub- 
problem generation and subproblcm solution. In this section we first give an 
outline of the strategy. Then details about subproblem generation are presented. 
After that, the subproblem solution is considered. 

The input of the DBS algorithm is the problem specification, represented by 
a CSP Po = {X, V,C) and characteristics of the method that may be defined by 
the user. Such characteristics must include a way to evaluate domain values, and 
a solution strategy to solve the subproblems. Algorithm 3.1 presents the general 
DBS scheme. 

3.1 Subproblem Generation 

The decomposition into subproblems is managed by a search tree. It can be di- 
vided into two parts: the search tree specification and the search tree exploration. 
The specification defines the nodes in the search tree, while the exploration de- 
fines the way of traversing those nodes. We will treat both concepts separately. 

Search tree specification The subproblem generation tree is specified by vari- 
able ordering and domain partitioning (based upon some domain value ranking). 
We list the basic ingredients for the specification of this search tree. 

Variable Ordering - This is the traditional variable ordering heuristic which 
specifics which variable will be used to expand the current node. The ordering of 
variables can be of great importance during dynamic domain partitioning. One 
widely used and problem-independent variable ordering heuristic in CP is the 



Algorithm 3.1 Decomposition Based Search 

Input: CSP Po, variable ordering (used in choose), domain value evaluator rank, 
domain partitioner partition, search selector select, depth bound d, subproblem 
solution strategy (used in solve), stop criteria stop 

open Po 

while stop not satisfied do 
select open node — » P 
if P at depth d then 

solve P 
else 

choose variable x 
rank domain values of x 
partition domain of x 
expand P 
end if 
end while 



first-fail principle: the variable viritli the smallest domain size is selected first. 
Another principle is to select the most constrained variable (i.e. the variable 
that occurs in the most number of constraints). As usual, problem dependent 
heuristics can be used as well. 

Dom,ain Value Evaluator - In order to rank domain values (function rank in 
Algorithm 3.1) we need a domain value evaluator, specified by the user. The 
ranking is characterized by two levels of accuracy: first, the rank should give a 
correct indication on which are the most promising values. Higher ranks should 
be given to more promising domain values. Second, it should discriminate among 
values. Here we introduce the concept of plateaus: a plateau is a set of values 
with the same (or very similar) rank (sometimes also called a tie). To perform 
a theoretical comparison among search strategies, we assume that the evaluator 
has a probability distribution that assigns a certain probability of success to 
each branch. Plateaus contain values with the same probability of success. 

Dom,ain Partitioner - Given a domain value ranking, the user has to specify 
how the domain has to be partitioned (function partition in Algorithm 3.1). In 
general, we partition domain Di into p subdomains Df'\ . . . , -Oj^"^^ with 'best' 
ranked values in the first subdomain of'^ and the worst ranked values in the 
last subdomain D'f~^\ 

The user has to specify the number of subdomains (possibly variable depen- 
dent), and the sizes of the diff'erent subdomains. An important point is that if 
the heuristics presents plateaus, the domain partitioning step should in general 
collect all values in a plateau in the same subdomain. Thus, the user can par- 
tition variable domains according to equivalent ranks. Another possibility is to 
partition domains on the base of their cardinality, e.g., split a domain into two 
subdomains, with the 10% best ranked values in the first and the other 90% in 
the second. 



Node Expansion - The procedure expand P in Algorithm 3.1 generates p children 
of a node P, being aware of the selected variable Xi and the domain partition 

D^,...,D'f-'^. Based upon the current node P = {X,V,C), the children P^ 

are defined as Pr = {X, !>,€), where D = {Di, . . . , Di-i, d\^\ Di^i, . . . , Dn}, 
with r e {0, . . . ,p — 1}. The procedure closes node P and opens its children. 

Search tree exploration The nodes of the search tree must be visited in a 
specific order, based upon the following characteristics. 

Search Selector - The search selector is implemented by the function select 
that chooses a node to expand from the frontier. In principle, any search selector 
ranging from Depth-First Search to LDS could be used, but LDS fits the most 
to the idea of DBS. Instead of LDS, also the Best Bound First (BBF) strategy 
could be suitable to the DBS framework. BBF is typically applied in a dynamic 
way, where it is convenient to recompute the bounds after each node expansion. 
When both the ranking heuristic and the bound computation have the same 
origin (say reduced costs and a solution from an LP relaxation as done in [10]), 
a dynamic version of LDS will often behave similar to BBF. 

In this paper we take into account a LDS Selector. Harvey and Ginsberg 
define LDS on binary search trees [5]. However, we need a general search strategy, 
therefore we cannot be limited to binary trees. In the following we recall two 
version of LDS when applied to a 6-ary tree (a search tree with branch width b, 
see Figme l.a). 

In principle, a 6-ary search tree can be mapped onto a binary search tree 
(see Figure l.b), but one has to take into account the depth of the resulting 
tree. When n variables ranging on b domain values are considered, the leftmost 
path from the root to a leaf in the binary search tree will be of depth n. On 
the other hand, the rightmost path will be of depth n*b, see Figure 1. This has 
to be taken into account when analyzing LDS on a 6-ary search tree. For the 
purpose of this paper, we have chosen not use binary trees with variable depths, 
but to maintain a 6-ary search tree with fixed depth n. For this reason, we need 
to distribute higher discrepancies along multiple branches, on multiple depths. 
A straightforward way to do so is the following. Each node in the search tree 
has b branches, ordered by some heuristic. The branches (ordered from left to 
right) contribute a discrepancy of up to 6 — 1 and have a corresponding label 
weighting the arc, i.e., Wij where i represents the depth of the search tree and j 
the fact that the arc is ranked j. The total discrepancy of a leaf node is the sum 
of all branches that form the path from the root node to this leaf, i.e., Y^^-i Wij 
j = 0..b — 1 (see also Figure 1). 

Now we still have a degree of freedom. At each discrepancy k we have two 
choices: the first one is to visit nodes labelled with discrepancy k independently 
from their order. However, when the heuristic used to label branches represents, 
for example, preferences, visiting nodes of discrepancy k in any order is not fair 
since we give the same importance to a choice where n — 1 variables have the first 
choice (that suggested by the heuristics) and one its k — th choice. Therefore, if 
the heuristics orders preferences, we have n — 1 variables completely satisfied and 



(0) (1) (6-1) (1) (2) (6) (b-im <2b-2) 

a. 6-ary search tree 



(6-2) : (b-l) 
b. binary search tree 



Fig. 1. Two corresponding (partial) search trees. The numbers 1,2, ... ,b represent do- 
main values. The numbers between parentheses represent the discrepancy correspond- 
ing to the above leaf nodes. 

one with its k — th preference. Among nodes with the same discrepancy, we could 
visit first those where the level of un-satisfaction is more balanced. Therefore, one 
could prefer to visit first the node where k out of n variables have a degree of 
un-satisfaction equal to 1. In this way, we apply an ordering to nodes with the 
same discrepancy. Before traversing a branch whose label is h we have to explore 
all those paths formed by branches labelled from up to /i — 1. This preference 
based ordering will be used to compare DBS with IB in Section 4.1. 

Depth Bounding - The user may be interested to partition domains only until a 
certain depth d. At level d, the subproblem solution procedure will start. When 
d is taken smaller than the depth of the search tree (together with a LDS search 
selector and single valued subdomains), DBS behaves similar to Depth-Bounded 
Discrepancy Search [13]. 

3.2 Subproblem Solution 

At a certain level d of depth in the search tree, the user has specified to solve the 
subproblem at hand. In order to solve the subproblem, several methods can be 
applied, which are often problem dependent. In the following, we present only a 
few of the possible methods to give some insights. 

An interesting aspect of the subproblem solution concerns the use of a differ- 
ent variable and value ordering heuristic with respect to that used for subproblem 
generation. Suppose that the first application of DBS for subproblem generation 
has grouped domain values with the same (or similar) ranking value. Using the 
same heuristic for the subproblem solution is not very informative since all val- 
ues belonging to the problem have a very similar rank. Thus, it is convenient to 
change the heuristic and use for instance one of the following search strategies. 

Standard labelling procedure - Solve the subproblem using traditional Depth- 



First Search. A motivation for this strategy is that all leaf nodes in the subprob- 
lem are equally likely to be successful with respect to the heuristic applied to 
the subproblem generation. Moreover, Depth-First Search is usually much faster 
than specialized search strategies. 

Iterated application of DBS - Another possibility is to apply DBS to the sub- 
problem again. As stated above, it would be useless to use the same heuristic for 
ranking domain values as the one used for subproblem generation. Instead, one 
should use a heuristic that captures a different property of the problem at hand. 
Thus, combining DBS at different levels yields an effective and simple method 
for breaking ties. 

Local Search - An alternative to the use of tree search could be the use of local 
moves on a landscape. In this case, we have to generate some initial solution of 
the subproblem, and try to improve it by performing problem dependent 'local 
moves'. The resulting approach is not 'complete'. 

4 Comparison with other approaches 

This section compares DBS with similar approaches to traverse a search tree, 
namely Iterative Broadening (IB) [2] and Limited Discrepancy Search (LDS) 
[5] . Note the distinction between LDS as sole search strategy (single- valued) and 
LDS as component of DBS to generate subproblems (multi- valued). 

For our comparison we make the following assumptions. DBS, IB and LDS 
are applied to the same search tree with fixed branch width b and depth n. 
Furthermore, we assume that a heuristic orders the branches in such a way that 
the probability that branch j leads to a successful leaf is pj, with Pi > P2 ^ 
• • • > Pb- As in [5], this probability is independent of the depth for the sake of 
simplicity. Thus the probability that the first leaf of the ordered search tree is 
successful is p". Finally, a fair comparison is established by the hypothesis that 
the heuristic is the same for all three approaches. 

As explained in Section 3, we have seen that DBS can be tuned by fixing the 
degrees of freedom. In the following we show that DBS can be tuned in such a 
way that it is equivalent to IB and even improves it by avoiding the repeated 
exploration of some nodes. 

Next we consider LDS and show the equivalence with DBS when the cardi- 
nality of each subdomain is taken one. In addition, we show that by considering 
more than one value in each subdomain, the first subproblem generated by DBS 
has a higher probability of being successful than LDS under certain conditions. 

Finally, we show experimental behaviour of LDS and DBS on the whole 
search tree, given a number of probability distributions among the branches 
being successful. 

4.1 Iterative Broadening 

Iterative Broadening (IB) (see [2]) introduces a breadth cut-off cq which is the 
maximum branch-width to explore in a Depth-First Search (DFS) tree. First 



Co is set to some initial value, and the corresponding search tree is traversed 
in a DFS manner. After that, we increase cq and traverse the extended scarc;h 
tree. Typically cq is only increased a small number of times, as to keep the total 
nodes to search as low as possible, while still being effective. It is proven that 
under certain assumptions IB performs better than DFS [2]. One drawback of 
IB is the rcdimdancy in traversing the search tree. Each time Cq is increased, the 
corresponding search tree has to be traversed from scratch, including the parts 
that were already visited in previous runs. 

The first subproblem generated by DBS can be seen as the first run of IB, 
where cq is the exact number of values to include in the best subdomain for 
each variable. If this subtree is being traversed in a DFS manner, DBS and IB 
behave equally in this first case. Moreover, when we apply LDS instead of DFS 
to traverse the subtree, DBS behaves provably better than IB (see [5]). 

Suppose that IB increases co to ci up to Cmax- Let the corresponding con- 
secutive runs be denoted by IB(ci). Define the following domain partitioner 
(denoted by (★)) for variable Xi, partitioning Di into Df^\ . . . , dI^'^^\ where 

£>-°^ = {di, . . . , dco}, and D^^ = {rfct_i+i, .. .dc^} {0 < t < max). Here dj rep- 
resents the domain value of Di corresponding to the j-th branch in the ordered 
search tree. Next, we apply a preference based ordered (described in Section 3.1) 
LDS strategy to the subproblem generation tree of DBS. Given a branch cut-off 
Ct {t G {0, . . . , Cmax}), let DBS(f)^*^ represent all subproblems of discrepancy k, 
using partitioner (★) restricted to subdomains with / < i, in which at least 
one is present. Applying this strategy up to discrepancy k = t*n, the sub- 
sequent runs of DBS(t)[,*^ exactly generate those leaf nodes generated by IB(ct) 
and not generated by IB(ct_i), yielding the following theorem. Here |DBS(f)^*'| 
denotes the number of leaf nodes generated by DBS(f)^*'. Similarly for |IB(ct)|. 

Theorem 1. Given DBS{t)'"^^ and IB(ct) as described above (t>0), 



As a consequence of this theorem, note that the redundant exploration in IB 
does not appear in the case of DBS. 

4.2 Limited Discrepancy Search 

For the definition of Limited Discrepancy Search we refer to [5] and to our 
definition for 6-ary trees given in Section 3.1. 




and 



5^|DBS(t)W| = |IB(c,)|-|IB(c*_i)|. 



Proof. Follows immediately from the above. 



□ 



When DBS is configured in such a way that the subdomains are restricted 
to contain only a single value, traversing the corresponding tree using a limited 
discrepancy strategy will be equivalent to LDS. More interesting is what happens 
when DBS applies a limited discrepancy strategy to subdomains of cardinality 
greater than one in comparison to LDS on single values. Then one can compare 
the total number of generated leaf nodes with the probability of success for both 
methods. In the following the first subproblem generated by DBS is compared 
with LDS on single values. 

Assume a domain partitioning of DBS in which the best ranked subdomains 
have cardinality c (with c < b). Let DBS(c) denote the first subproblem generated 
by DBS, corresponding to discrepancy 0. The total number of leaf nodes of 
DBS(c) is c". The probability of success is 



Next the same analysis is performed for LDS. Let LDS(fc) denote the search 
subtree consisting of all paths of discrepancy k from the root to the leaf nodes. 
At depth n of the search tree, the paths of discrepancy k can be viewed as 
partitioning the integer k into exactly n integers between and b. Formally, 
define the set of partitions of an integer k as 



= {TTi = (Trf \7rf \ . . . ,7rl"^) | integer, < tt^'^ < b, J^^'^ = k} 



Furthermore, each partition tt^ can occur several times. We denote its multiplicity 
as Hi. The number of leaf nodes of discrepancy k is thus X^-^^' Hi - The probability 
that these nodes are successful is 



Let LDS((i)^^o denote the search subtree consisting of all paths of discrepancy 
up to fc from the root to the leaf nodes. Then 

prob(LDS(d)^^Q successful) = X]d=o prob(LDS(c?) successful). 

Next we present two results that relate the probability of success of DBS and 
LDS. The first result considers a search tree in which the first c branches are 
ranked equal (called a plateau). The second result considers a search tree in 
which no plateaus occur. 

Theorem 2. Given pi = P2 = ■ ■ ■ = Pc > Pc+i > Pc+2 > ■ ■ • > Pb, 1 < c < c 
andO<k< n{b-l): 




n 



J = l 




prob(DBS(c) successful) prob(LDS((Z)^^o successful) 



Proof. The inequality compares the mean probabihty of success per leaf node 
of DBS(c) and LDS(d)^^p. For DBS(c) this is j// for all c < c. This is the same 
for LDS(d)^^Q when k < c. For k > c, LDS(fc) also uses branches with pc+i up 
to pb which are strictly smaller than pi up to pc- Hence the mean probability of 
success per leaf node decreases for LDS(A;). □ 

Corollary 1. Given a problem instance in which for each search variable a 
plateau of size c is ranked best, DBS(c) is more likely to be successful than 
LDS(d)'^^Q on a comparable number of generated leaf nodes. 

Proof. Direct application of Theorem 2. □ 

We now consider the case when the branches all have strictly different prob- 
abilities of success. In the following theorem we compare the first subproblem 
generated by DBS(c), containing c" leaf nodes, with any LDS((i)^^Q search tree 
containing at most c" leaf nodes. In other words, we fix c (and hence DBS(c)), 
and make sure that LDS((i)^^Q does not generate more leaf nodes than DBS(c). 
In that case, DBS(c) is more likely to be successful than LDS(d)^^oi assuming 

Theorem 3. Given pi > p2 > ■ ■ ■ > Pb with Pi~^Pc+i < Pc? n > 1, 1 < c < b, 
< k < n{b — 1) and LDS(d)j^_Q is allowed to generate at most c" leaf nodes: 

prob(DBS(c) successful) > prob(LDS(d)^^Q successful), 

In particular, equality only holds for the pairs {c = l,k = 0), {c = b — l,k = 
n{b - 1) - 1) and {c = b,k = n{b - 1)). 

Proof. It is easily seen that equality holds only for the pairs (c = l,k = 0), 
(c = b — \,k = n{b — 1) — 1) and {c = b,k = n{b — 1)) because for each pair 
the generated search trees are equivalent (note that n(b — 1) is the maximum 
discrepancy of LDS). 

The strict inequality comes from the following observation. LDS(d)^^Q can 
generate at most c" leaf nodes, and by nature it differs at least one leaf node 
from DBS(c) when n > 1. Therefore LDS((i)^^o can be built from DBS(c) by 
interchanging DBS(c) leaf nodes for LDS(d)^^Q leaf nodes. Consider the worst- 
case interchangement that can occur. The rightmost leaf node inside the DBS(c) 
search tree has the smallest probability of success within that tree, namely p". 
The 'first' leaf node of LDS(d)^^g outside the DBS(c) tree is one of n in which 
one branch is of discrepancy c (branch c + 1) and the others of discrepancy 
(branch 1). This leaf node has probability of success p"^^pc+i, being the 
highest outside the DBS(c) tree. Since p"~^pc+i < P^, non-DBS(c) leaf nodes 
have a strictly smaller probability of success than DBS(c) leaf nodes. Hence the 
interchangement will decrease the total probability of success of LDS(d)J;^Q with 
respect to DBS(c). □ 



4.3 Theoretical comparison of LDS and DBS 



In this section we compare the behaviour of DBS and LDS on a whole search 
tree, given three different probabihty distributions of being successful among the 
branches. We have chosen to compare linear, poisson and binomial probability 
distributions, depicted in Figure 2. This choice is motivated by the different 
slopes of the distributions, which will influence the performance of DBS and 
LDS. For each probability distribution, also a version containing plateaus has 
been used. Such a distribution consists of 4 plateaus of size 2, following the 
same distribution as its origin (although being scaled to make the sum among 
all branches equal to 1). 

Figure 3 depicts the results of our experiments. It shows the cumulative 
probability of success for DBS and LDS. DBS is plotted in two different ways. 
The first way represents DBS on subdomains of size 2 using a limited discrepancy 
strategy to generate subproblems (indicated by 'DBS(2), with LDS'). The second 
represents DBS(c), the first subproblem generated by DBS, where c is the size of 
the best ranked subdomains and ranges from 1 up to &/2 (indicated by 'DBS(c)'). 
The latter corresponds to DBS(c) in Section 4.2. 

Figures 3. a and 3.b make use of a linear descending probability distribu- 
tion among the branches, with and without plateaus. One can observe that for 
this distribution the performance of DBS and LDS is almost identical, although 
'DBS(2) with LDS' performs slightly better than LDS when plateaus are present. 

In Figures 3.c up to 3.f the used probability distributions are poisson and 
binomial (both distributions are scaled such that the sum among the branches 
equals 1). These figures show a better performance for 'DBS(2) with LDS' com- 
pared to LDS, especially in the presence of plateaus. Another observation con- 
cerns DBS(c) compared to LDS. Even in case of plateaus, enlarging c does not 
necessarily make DBS(c) better than LDS. 
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Fig. 2. Probability distributions among the branches being successful. 
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Fig. 3. Cumulative probability of success for LDS and DBS on search tree of width 8, 
depth 8 and linear, poisson and binomial probability distributions. 



5 Computational Results 



This section presents computational results of two applications for which we have 
compared DBS and LDS. The first is the traveling salesman problem, the second 
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N.A. means 'not applicable' due to time limit (900 s). 



Table 1. Results for finding optima of TSP instances (not proving optimality). 



the partial latin square completion problem. For each application we state the 
problem, define the applied heuristic and report the computational results. 

For the implementation of the applications we have used ILOG Solver [8] and 
Cplex [7] on a Pentium IGhz with 256 MB RAM. 

5.1 Traveling salesman problem 

The traveling salesman problem (TSP) is a traditional NP-hard combinatorial 
optimization problem. Given a set of cities with distances (costs) between them, 
the problem is to find a closed tour of minimal length visiting each city exactly 
once. 

For the TSP, we have used a heuristic similar to the one used in [10]. It 
relies on the reduced cost matrix that originates from the solution of a linear 
relaxation (an assignment problem) inferred from the TSP. The heuristic ranks 
those values best that are associated to the lowest reduced costs. Intuitively this 
is motivated by the fact that those values will contribute the least to an optimal 
tour. Differently from [10] we now apply this heuristic in a dynamic way. This 
means that the subdomains are not selected beforehand (statically) but during 
the subproblem generation. This approach avoids the inclusion of already pruned 
domain values. Secondly, for each variable we only include values that have the 
same (lowest) reduced cost, instead of a range of low reduced costs. 

The further tuning of DBS consists of the following. The subproblems are 
generated using a limited discrepancy strategy, without preference ordering con- 
cerning the discrepancies. Subproblems are being solved using depth-first search, 
since all leaf nodes can be considered to have equal probability of success. 

To compare LDS and DBS fairly, we stop the search as soon as an optimal so- 
lution has been found. The proof of optimality should not be taken into account, 
because it is not directly related to the probability of a branch being successful. 



The results of our comparison are presented in Table 1. The instances are 
taken from TSPLIB [12] and represent symmetric TSPs. For LDS and DBS, 
the table shows the time and the number of fails (backtracks) needed to find 
an optimum. For LDS, the discrepancy of the leaf node that represents the 
optimum is given. The discrepancy of the subproblem that contains the optimum 
is reported for DBS. 

For all instances but one, DBS performs much better than LDS. Both the 
number of fails and the computation time arc substantially less for DBS. Ob- 
serve that for the instance dantzig42 LDS needs less fails than DBS, but uses 
more time. Here is where the depth-first search strategy for solving the DBS 
subproblems pays off. It can visit almost three times more nodes in less time, 
because it lacks the LDS overhead. 

5.2 Partial latin square completion problem 

The partial latin square completion problem (PLSCP) is a well known NP- 
complete combinatorial satisfaction problem. A latin square is an n x n square 
in which each row and each column is a permutation of the numbers {1, . . . , n}. 
For example; 
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2 



is a latin 4x4 square. A partial latin square is a partially prc-assigncd square. 
The PLSCP is the problem of extending a partial latin square to a feasible 
(completely filled) latin square. 

As heuristic wc have used a simple first-fail principle for the values, i.e. values 
that are most constrained are to be considered first. This means, a value that 
occurs the most inside a partial latin square is ranked best. Hence the rank of a 
value is taken equal to the number of the value's occurrences in the partial latin 
square, and a higher rank is regarded better. 

In our implementation, DBS groups together values of the same rank to 
generate subproblems, using a limited discrepancy strategy without preference 
ordering concerning the discrepancy. The subproblems are being solved using a 
depth-first strategy, since we consider all values of the same rank to be equally 
successful. Furthermore, the CSP that models the PLSCP uses alldifferent 
constraints on the rows and the columns, with maximal propagation. The max- 
imal alldifferent propagation (achieving hyper-arc consistency) is of great 
importance for solving the PLSCP as a CSP. With less powerful propagation, 
the considered instances are practically unsolvable. 

In Table 2 we report the performance of LDS and DBS on a set of partial 
latin square completion problems. The instances are generated with the PLS- 
generator Isencode by Gomes et al. [3]. Following remarks made in [4], our 
generated instances are such that they are 'diflacult' to solve. The instances 
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pis . orderSO . holes336 
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0.76 


12 
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5069 
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29.41 


8026 
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28.40 
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5.41 
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9.05 
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2 


8.35 


1103 


2 
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2.15 
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43.80 
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sum 


1211.45 


220793 


91 


396.62 


159773 


81 


mean 


46.59 


8492.04 


3.50 


15.25 


6145.12 


3.12 



Table 2. Results for PLS completion problems. 



bpls . order25 .holesmarc balanced 25x25 partial latin squares, with m unfilled 
entries (around 38%). Instances pis. orderSO. holesm are unbalanced 30 x 30 
partial latin squares, with m unfilled entries (around 38%). 

Again, we report the time and the number of fails (backtracks) needed to 
find a solution for both LDS and DBS. The discrepancy of the leaf node that 
represents the solution is reported for LDS, for DBS this is the discrepancy 
of the subproblem that contained the solution. Although DBS performs much 
better than LDS on average, the results are not homogeneous. For some instances 
LDS even found a solution at a lower discrepancy level than DBS. This can 
be explained by the pruning power of the alldiff erent constraint. Because 
DBS branches on subdomains of cardinality larger than one, the alldiff erent 
constraint will remove less inconsistent values compared to branching on single 
values, as is the case with LDS. Using DBS, such values will only be removed 
inside the subproblems. 

As was already mentioned in Section 5.1, DBS effectively exploits the depth- 
first strategy which it is allowed to use to solve the subproblems. For a number of 
instances, DBS finds a solution earlier than LDS, although making use a higher 
number of fails. 



6 Conclusion 



In this paper, we presented a theoretical and experimental evaluation of an effec- 
tive search strategy, Decomposition Based Search (DBS), based on value ranking 
and domain partitioning. We have shown that DBS can be tuned to implement 
two well known search strategies, namely Iterative Broadening and Limited Dis- 
crepancy Search. Concerning IB, we show that DBS explores the same number 
of nodes of each IB iteration, but avoids restarts. As far as LDS is concerned, we 
prove that DBS has a higher probability of success on a comparable number of 
nodes. Experimental result on the partial latin square completion problem and 
on the traveling salesman problem show that DBS outperforms LDS in almost 
all cases. 
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